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Abstract 



We give lower bounds on the largest singular value of arbitrary matrices, some of 
which are asymptotically tight for almost all matrices. To study when these bounds 
are exact, we introduce several combinatorial concepts. In particular, we introduce 
regular, pseudo-regular, and almost regular matrices. Nonnegative, symmetric, al- 
most regular matrices were studied earlier by Hoffman, Wolfe, and Hoffmeister. 
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1 Introduction 

Let S (A) be the sum of the entries of a matrix A. Hoffman, Wolfe and Hofmeister 
p] showed that if A = (ay) is a nonnegative symmetric matrix with positive rowsums 
di, . . . ,d n and \i (A) is its largest eigenvalue, then 



with equality holding if and only if didj = /i 2 (A) whenever ay > 0. 

The aim of this note is to extend this result in several directions. First, instead of 
H (A) , we consider the largest singular value a (A) , thereby dropping the requirement 
that A is symmetric, square, and nonnegative. Second, we present wider classes of lower 
bounds on a (A) some of which are asymptotically tight for almost all matrices. Finally, 
we study when these lower bounds are exact, thus introducing regular, pseudo-regular, 
and almost regular matrices. We also introduce a few combinatorial concepts to support 
the study of structural properties of arbitrary matrices. 

For basic notation and definitions see [2|. Specifically, we call a matrix scalar if it is 
a scalar multiple of a nonnegative matrix. Also, we write j m for the vector of m ones. 
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2 Main results 



Let A = (ciij) be an m x n matrix with row and column sums T\, . . . , r m and c\, . . . , c n . 
We first generalize the values q and rj. Index the rows and columns of A by the elements 
of two disjoint sets R = R (A) and C = C (A) . For all i G R U C, set w\ (i) = 1; for all 

s >2, i e R, j e C, set 

w a (*) = E flifc^A -1 (A;) , (j) = J] afcj^" 1 (A;) . 

fcec fcei? 

Finally, for all s > 1, set 



fce-R 



fcec* 



Note that 



r« if i G -R, and w A {%) = q if i G C. Also, if A is the adjacency 



matrix of a graph, tu^ (i) is the number of walks on s vertices starting with the vertex i. 

Using somewhat different notation, in [5] it is proved that for every m x n matrix A 
and all odd p and r such that p > r > 1, 



(A) w\ (R) > w p A (R) 



(2) 



lim < +2S+1 ^ 



lim max 



w 



2r+2s+l 



(k) 



(3) 



Moreover, for all s > 1, 

1 J ™ w A r+1 (R) ™ fc gS("i) u^ r+1 (A;) 

unless the eigenspace of AA* corresponding to a 2 (A) is orthogonal to j m . 

Note that: (i) inequality (j2J) may not hold if p or r are even (see p], p. 728 and [I], p. 
262); (mJ equalities flSj) hold if A is a nonzero scalar matrix; (m,) inequality (J2]) implies a 
number of known results on the spectral radius of graphs (see [3j, p. 258). 

Inequality (j2J) can be proved using the Rayleigh principle. This simple approach helps 
produce other similar bounds of increasing complexity. We shall focus on the following 
general inequality. 

Theorem 1 Let A be a matrix, R = R (A) and C = C (A) . Then for all r > 1, 

a (A) JwJ A] (R) wJ A] (C) > E a tJ Jwr A] (i)wJ Al (j) . (4) 

Particularly, for r = 1 Theorem [T] reads as 

a(A)>\E(A)\/y/nm. (5) 
Also, since wf^ (R) = w? A * (C) = £ (\A\), for r = 2 Theorem Q] extends inequality ([TJ to 



<j(A)Z(\A\)> 



E a ij\/W\A\ U) 



'\A\ 



It is natural to study when equality holds in inequalities ([2]) and (jlj). To this end we 
first introduce some combinatorial concepts. 
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2.1 A few combinatorial concepts 

For any matrix A = (a^) , let B (A) be the bipartite graph with vertex classes R (A) and 
C (A) such that i E R (A) is joined to j G C (A) whenever cijj 7^ 0. 

Call a matrix A connected if B (A) is connected. Note that a symmetric matrix is 
connected exactly when it is irreducible. 

For scalar matrices connectedness can be expressed in terms of their powers. 

Proposition 2 A scalar matrix A is connected if and only if for every i e R (A) , j e 
C (A) , there exists r such that the entry of (AA*) r A is nonzero. 

Call a maximal connected submatrix of A a component of A. 

We say that A is cogredient to B if there exist permutation matrices P and Q such 
that A = PBQ. 

The following two assertions are obvious. 

Proposition 3 If a matrix A has no zero rows or columns, then it is cogredient to a block 
diagonal matrix 

( A 1 ••• \ 

\ ■ ■ • A r j 

where Ai, . . . , A r are the components of A. 

Proposition 4 The multiset of the nonzero singular values of A is the union of the 
multisets of the nonzero singular values of its components. In particular, for every matrix 
A, 

a (A) = max {a (C) : C is a component of A} . 

Let A be a nonzero scalar matrix. We call A regular if its row sums are equal and so 
are its columns sums. 

We call A pseudo-regular if w\ (i) = \w\ (i) for all i 6 R (A) and fixed A. Equivalently, 
A is pseudo-regular if the vector with coordinates w\ (i) , i G R (A) is an eigenvector of 
AA*. 

If each component C of A is regular and a (C) = a (A) , we call A almost-regular. 

Note that regular matrices generalize doubly stochastic matrices. Pseudo-regular ma- 
trices generalize the adjacency matrices of pseudo- regular and pseudo-semiregular graphs 
(see |6] for a comprehensive survey). Almost regular matrices extend the concept intro- 
duced for nonnegative symmetric matrices in [3]. 

It is easy to see that regular matrices are almost regular, and that almost regular 
matrices are pseudo- regular. However the matrix 

/ 1 1 \ 
A= 1 1 
\ 1 1 / 

is connected and pseudo-regular, but not regular. Note also that A* is not pseudo-regular. 
Here is a complete characterization of pseudo-regular matrices. 
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Proposition 5 A nonzero m x n scalar matrix A is pseudo-regular if and only if the 
following conditions hold: 

(i) the vector with entries w A (i) , % 6 R (A) is an eigenvector of AA* to some nonzero 
eigenvalue fi (AA*) ; 

(ii) the eigenvectors of AA* to every nonzero eigenvalue f/f (AA*) ^ fi(AA*) are or- 
thogonal to j m . 

Using this characterization, we can relax the definition of pseudo-regularity, preserving 
the same property scope. 

Proposition 6 Suppose that A is a scalar matrix, r, s are odd, and r > s > 3. Ifw r A (i) = 
Xw A (i) for all i e R (A) and fixed A, then A is pseudo-regular. 



2.2 Sufficient conditions for equality in ([2]) and (J4J) 

The following theorem gives a condition for equality in (jSJ). 

Theorem 7 Suppose that A is a scalar matrix with R = R (A) . If 

a 2s (A)w\ r+1 (R) = w\ r+2s+1 (R). 

for some s > 1, r > 0, then A is pseudo-regular. 

Similar double condition implies a stronger conclusion. 

Theorem 8 Suppose that A is a scalar matrix with R = R (A) , C — C (A) . If 

a 2s (A) w\ (R) = w\ s+1 (R) , (6) 
a 2r (A) w\ (C) = < +1 (C) (7) 

for some r,s > 1, then A is almost regular. 

Next, we generalize the second part of the aforementioned theorem of Hoffman, Wolfe, 
and Hofmeister giving conditions for equality in (j3J). 

Theorem 9 Let A = (a^) be a scalar matrix and r > 1, s > 1. The following three 
conditions are equivalent: 

(i) A is almost regular; 

(ii) \w T A (i) w r A (j)\ = a (A) 2 \w A (R) w r A (C)\ whenever ^ 0; 



(Hi) we have 



a(A)J\w A (R)w A (C)\= Z <hjJ\w r A {i)w r A (j)\ 



(8) 
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A stronger condition holds for equality in (J4]) with r = 1. 

Theorem 10 A scalar matrix A e M m ^ n is regular if and only if a (A) = |S (A)\ / y/nm. 

Note that the assumption that A is scalar is essential in Theorems [7| to [TD]. Indeed 
letting 

' 1 + i 1 -i 
1 - i 1 + i 



we see that 



a (A) =2, £(A)=4, w\(R)=w 1 A (C) = 2, 
w\ (R) = w\ (C) = 4, = 8, 



E «y 



E 2a ij 
i£R,j&C 



Thus, we have 



a 2 (A) w\ (R) = w\ (R) 
a (A) y/\w\(R)wl(C)\ 

v(A) = \E(A)\/2 

although A is not scalar. 



E a ij 

ieR,jeC 



3 Proofs 

Proof of Theorem [I] Set x% 



wT A (i) / w \a\ (-^) ^ or all z G i? and let x 



X; 



Likewise, set yi = \/wT A , (i) I w \a\ (^) ^ or an ^ G C an d let y = (Vi) ■ Since ||x| 



by Schur's lemma [7j, we obtain 



a (A) = max \(Au,v)\ > |(Ax,y) 

u = v =1 



^ ^ (C) 



completing the proof. 



□ 



In the proofs below we shall assume that A is an m x n, nonzero, nonnegative matrix 
with R = R (A) and C = C (A) ; 7*1, ... , r m , ci, . . . , c n are its row and column sums, and 
cr = 0i > • • • > a m are its singular values. 
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Let AA* = VDV* be the unitary decomposition of AA*; thus, the columns of V are 
the unit eigenvectors to a\,...,a^ n and D is the diagonal matrix with a 2 , . . . , a 2 ^ along 
its main diagonal. Then for every I > 0, 



21 

i i 



where c,- 
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SjG[m] u i« > is independent of Z. 



Note also that for all r, s > 0, 

E^< +1 (<) < +1 (<) = < +2s+1 («) ■ (9) 
We omit the easy proof by induction on s. 

Prrof of Theorem [7] In the above notation we have 

rr 2s ST n rr 2r — rr 2s ^n 2r + 1 ( H\ — „n 2r + 2s + 1 CP\ — r- rr 2r + 2s 

id[m\ ig[m] 

Hence, if < of < a 2 , then q = 0. Therefore, for all r > 1, we have w A +1 (R) = Ca 2r , 
where C is independent of r. Specifically, 

w\ (R) = Ca 4 , w\ (R) = Ca e , w\ (R) = Ca 8 . 

Note the following instances of identity (Q 

= £ W(*)) a . <(R)=E<(k)w 3 A (k), w* A (R) = E KW) 2 • 

fcei? fceR fcei? 

Hence, using the Cauchy-Schwarz inequality, we obtain 



cv 6 = W \ (R) = E^i (k) w\ (k) < E K W) 2 E K (*))' 

feefl V fceR fee/? 



(fl) u£ (i?) = Ca 6 . 

We have equality in the Cauchy-Schwarz inequality; hence for each k e R, w A (k) = 
\w A (k) , where A is independent of k. Therefore A is pseudo-regular, completing the 
proof. □ 



Proof of Theorem [8] In our proof we first show that a (AA = a for every component of 
Ai and that conditions and (JTj) hold for each component of A. Let A\, . . . , be the 
components of A. For each i e [k] , by inequality (j2j) we have 

a 2r (Aj) |i? (Ai)\ > w% +1 {R (Ai)) , 
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and so 

cr 2r \R\ > E ° 2r (A) \R (A)| > E < +1 (i? (A)) = < +1 (i?) • 

ie[fe] ie[k] 

Therefore, condition (jSJ) implies that a (Aj) = a for all i E [k] . We see also that condition 
dUl), and likewise condition (171), holds for every component of A; hence, we can assume 
that A is the sole component, i.e., A is connected. To finish the proof, we have to show 
that A is regular. 

Since <7 2 u# -1 (R) > w 2 A s+1 (R) > for all s > 1, condition © implies that 
a 2 (A) = w\ (R) = "£w\ (i) = E aijflfci 

Hence, j m is an eigenvector of AA* to a 2 and so, for each i E R, 

U Q'ijQ'kj ^ y QjijCj. 

j€C,k£R ' ' j£C 

Let 

5/? = minrj, 5c = mincj, A# = maxr^, Ac = maxQ, 

i£R i£C ieR ieC 

and select s G i? such that r s = 5r. Then 



E = J2 a sjCj < A c J2a sj = A C 5 R . (10) 



a 

jac,k£R jec jec 



Likewise, we see that a 2 > 5cA R . Applying the same argument to A* we find that 

A C 5 R <a 2 < A R 5 C . 



Therefore, A C 5 R = a 2 = A R 5c- This implies that equality holds in ffTUl) . and so Cj = A c 
whenever a S j ^ 0. Likewise, we see that if t G R is such that c t = A c , then r 3 - = S R 
whenever dj t ^ 0. Since A is connected t\ = ■ • ■ = r m and c\ = ■ ■ ■ = c n , completing the 
proof. □ 



Proof of Theorem [9] The implications (i) => (ii) ==>- (in) are obvious, so we shall 
focus on (in) =^> (i). As in the proof of Theorem [8], we first reduce the argument to 
connected matrices. Let Ai,...,A& be the components of A. By Theorem [Q for each 
s G [k] , we have 



a (A a ) Jw As (R (A a )) w As (C (A s )) > E J< s « ™a s U), 

v ieR(A s ),jec(A s ) v 
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and, using the Cauchy-Schwarz inequality, 



a x /w A (R) w A (C) = a A I E v> r A. (R (A)) E (C (4,)) 

se[k] se[k] 



se[k] 



> Z°(A s )Jw Aa (R(A s ))w As (C(A s )) 

s£[k] V 

> E E a ij\/ w As ^ w As CO 

se[fc]ie-R(A fl ),jGC(A s ) v 



Therefore, condition (jSj) implies that cr (Aj) = a for all i 6 [k] . We see also that 
condition (jSJ) holds for every component of A; hence, we can assume that A is the sole 
component, i.e., A is connected. To finish the proof we must show that A is regular. 

Let B = (bij) be defined as a block matrix 



B 



A 

A* 



It is known ([2], p. 418) that the positive eigenvalues of B are the nonzero singular values 
of A. Set for convenience R = [m] and C = [m + l..m + n] . By induction on r it is easy 
to see that for every r > and for each i G [m + n] , the value w r A (i) is equal to the ith 
row sum of B r . 
Let 



%i = J w\ A \ (i) for i G [m] , Vi = J u>\a\ (* + m ) for * G W > 
x = (xi, . . . ,x m ) , y = (t/i, . ..,y„) , z = (ari, . . . ,x m ,y u . . . ,y n ) . 
Our main goal is to show that 

w \a\ (!) = ••• = ijn) , w[ A| (m + 1) = • • • = w\ Al (m + n) (11) 

Equation (jSJ) and the Rayleigh principle imply that z is an eigenvector of B to a; hence 
z is an eigenvector of B r to a r . Assume first that r is even, say r = 2k. We have 



and so, 



(A*A) k 1 A* 1 



m+n 

a 2k ~ l Xi = E hjUj-m for z G [m] , (12) 
(T 2fc-1 |/i_ m = E for « e [m + l..n] . (13) 
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Let 



5r = min w 2 ^ (i) , 5c = min w 2 ^ (i) , Ar = maxw* (i) , Ac = maxw* (i) . 

ie[m] ieC ieR «ec 

Select s G [m] such that x s = 5r. Then, by f[T2"j) , 

n n 

^v 7 ^ = ^ k ~^s = E < E 6-i = v 7 ^?, (14) 

j=m+l j=m+l 

and so o 2k ~ x < y/ A c 5r. Likewise, we see that cr 2fc_1 > y/ A R 5c- Applying the same 
argument to equation (fTB"]) . we find that 

V&cSr < cr 2 '- 1 < x/A R 5 c . 

Therefore, AqSr = o 2k ~ x = A R 5c- This implies that equality holds in ffl4"|) . and so 
w 'a U) = Ac whenever b S j 7^ 0. Likewise, we see that if t e [m+l..n] is such that 
w 'a (*) = Ac, then ty 2 ^ (J) = 5r whenever bj t ^ 0. Since A is connected, f fTTl) holds for 
even r. The proof of ffTTj) for odd r goes along the same lines and we omit it. 

Note that (TTTT) implies that j m + n is an eigenvector to B and thus all row and column 
sums of A are equal, completing the proof. □ 

Proof of Theorem 1101 Suppose A is regular. Schur's inequality [7j 

a 2 (A) < max T:C~, 

implies that a (A) < £ (A) / y/nm. In view of (jHJ), we deduce that a (A) = £ (A) / y/nm. 
Suppose now o (A) = S (A) / y/nm. We have 

a 2 (A) m > (AA*j m , j m > = £ o^ay =^c->-(S (A)) 2 = a 2 (A) m, 

i,k&R,j^C j£C n 

implying that C\ = ■ ■ ■ = c n . Likewise we find that r\ = ■ ■ ■ = r m , completing the proof. 

□ 

Concluding remark 

It seems a challenging problem to investigate the cases of equality in () and () for 
arbitrary matrices. 
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